Dynamic Index Construction with Deep Reinforcement Learning
نویسندگان
چکیده
Abstract Thanks to the rapid advances in artificial intelligence, a brand new venue for database performance optimization is through deep neural networks and reinforcement learning paradigm. Alongside long literature this regime, an iconic crucial problem index structure building. For problem, prior works have largely adopted pure learning-based solution replacing traditional methods such as B-tree Hashing. While line of research has drawn much attention field, they ubiquitously abandon semantic guarantees also suffer from loss certain scenarios. In work, we propose Neural Index Search (NIS) framework. The core framework train search policy find near optimal combination plan over existing structures, together with required configuration parameters associated each plan. We argue that compared against approaches, NIS enjoys advantages brought by chosen conventional structures further robustly enhances any singular structure. Extensive empirical results demonstrate our achieves state-of-the-art performances on several benchmarks.
منابع مشابه
Deep Reinforcement Learning for Dynamic Multichannel Access
We consider the problem of dynamic multichannel access in a Wireless Sensor Network (WSN) containing N correlated channels, where the states of these channels follow a joint Markov model. A user at each time slot selects a channel to transmit a packet and receives a reward based on the success or failure of the transmission, which is dictated by the state of the selected channel. The objective ...
متن کاملDeep Reinforcement Learning with POMDPs
Recent work has shown that Deep Q-Networks (DQNs) are capable of learning human-level control policies on a variety of different Atari 2600 games [1]. Other work has looked at treating the Atari problem as a partially observable Markov decision process (POMDP) by adding imperfect state information through image flickering [2]. However, these approaches leverage a convolutional network structure...
متن کاملReinforcement Learning with Deep Architectures
There is both theoretical and empirical evidence that deep architectures may be more appropriate than shallow architectures for learning functions which exhibit hierarchical structure, and which can represent high level abstractions. An important development in machine learning research in the past few years has been a collection of algorithms that can train various deep architectures effective...
متن کاملDeep Reinforcement Learning with Double Q-Learning
The popular Q-learning algorithm is known to overestimate action values under certain conditions. It was not previously known whether, in practice, such overestimations are common, whether this harms performance, and whether they can generally be prevented. In this paper, we answer all these questions affirmatively. In particular, we first show that the recent DQN algorithm, which combines Q-le...
متن کاملOperation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm
: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Data Science and Engineering
سال: 2022
ISSN: ['2364-1541', '2364-1185']
DOI: https://doi.org/10.1007/s41019-022-00186-4